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ABSTRACT _ , ^ 

This paper presents a rationale for taking a 

developaental perspective tdwards evaluation of early childhood 
programs and contrasts two models of development (organismic and 
mechanisticl wi^h regard evaluation and developmental issues. 
Examination of thedreti^al differences b-atsien tfei oirganisBic model 
(which, assumes an active organism) and mechanistic ni<)del Jwhich 
assumes a reactive organism) suggests that a developmental 
perspective: (1) implies that behavioral bbservatibns must be 
analyzed with respect tc their meaning in conteitj (2) raises the 
question ^of the meaningfulness of educational tes"!!^ (3). 
is important in the conceptualization of development an early . 
chiidhccd programs; and (4^ leads to a ^hift away from a ' 
preoccupation with criterion performance. to a concern with the 
processes underlying performance^ A d(gvelepmental perspective also 
emphasizes: changes. in cognitive structures rather than behavioral 
change per se.; discontinuity father tian continuity^^b 
reciprocal causality between organism and environment rather than _ 
unidirectional causality of environment on organism; and organized 
complexity rather than linear causality in change. The implications 

pf these model features for assessing program effectiveness are^ 

discussed^ The rationale presented for working toward a devolopmentai 
perspective in evaluation highlights the invclvemfnt of participants 
in understanding program development^ adult fstaff and parenti 
development; and child development, (J.fifi) : 
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EDUCATION POSITION OR POLICY - ■ . 

•The widespread evaluation of social action and educational programs 

• • ■ ■ .» ■ 

15 barely a decade old (Ross & Crohbach, 1975}:. Much of this evaluation 

activity has centered on programs serving low-income and mioci^ity grotj'p 

/ ; ' children and their families- The mandate for the evaluation M these 

Lij early childhood programs took the fields of developmental psychology and 

early childhood education by surprise; Few individuals existed in 

either field in the mid-^BDs v/ho were knowledgeable and trained: in* 

evaluation, which itself lacked a theory unique to its special • problems 

(Guba, 1969). In this, vacuum, evaluation became associated- with the • " ' . . 

measurement, of child outcomes which could be reliably assessed. One 

result was that certain valuative^ epistemological ^ and conceptual 

' ; assumptions' related to research with young, developing children were 

overlooked. 

For a number of reasons, the evaluation of programs .serving young ^ 
^^J^ children. and their families continues to be ah important social and -■ , 

'scientific issue. The most important reason for continued controversy^ 
- is the diversity of strongly held beliefs regarding tl^e effectiveness of 
these programs among diverse constituencies (Katz,1975; Zigler, Note lO). 
This paper acknowledges the inherently political nature of evaluation 
activities (i3atta^ 1976; Houses 1973)^ but focuses -^as a task on a'develop- 
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The myor points of this paper can -be samfnarizcc'. 

1: The evaluator's model of development ^ whether ^:iX^lic1t or 

implicit^ 15 reflected in his/desigh and diDirig bt evaluation. Models of 

development infltieaee. decisions about^^what-are considered meaningful 

problems or questions to pose in an evaluation^ what methods of data . 

collection and analysis will be used-How the data will be- interpreted^ 

and v/hat implications for policy are drawn; Progress in evaluating 

.early childhood ^programsshould not be only* associated with increasingly 

sophisticated research designs and advanced statistical techniques. 

Fundamental questions about the nature of tfuman development as well as 

the purposes. of evaluation are also involved. - 

2. The evaluation of early childhood programs, like most evaluation 
- ' ■ ' ■ - ' 

studies, is dominated by psychdmetric, experimental., and behavioristie 

models (Eisner, 1977; Guba, 1969; Rouse, 1976; Levine, 1974; Patton, 
Note 4). Program outcomes have been limited to standardized measures 
vhich can be reliably assessed, e.g., IQ and'achievement, v/ith less 
attention to the meaningfuTriess of v/hat is being measured (Hessick, 
1975). Within the dominant evaluation models change is defined quantita- 
tively as the acquisition. of more pieces of information, knowledge, and 
experiences v/ithbUt attention to the struettires underlying observed 
changes. / A child^s behavior or performance* is assessed to deterrnine his 
position in relation to single .standards, e.g., iritell-igence tests 
(Riegel, 1972). ' * 

3. Evaluation lacks a perspective v/hich is grounded in the nature 
of developmental change and in which mSansy-enus relations and their . 
trahsfdrmatibris are- central, i will argue that tfiere is an incongruency 



Within a developmental perspective, change is considered tq be qualita- 
tive as well as quantitative: "New properties ..e,ner^, irreducibl^ to 
lower level^and. therefore, qualitatively different from thern" (Overton 
& Reese; 1973. p. 70). There are ..ultiplB influences on development 
which result from a complex transaction between prnal . and external : 
forces.. The nature of developmental change f . considered to be dynamic 
^ and differentiated with multiple outcomes as'^ejl aslltiple pathway^ 
to similar behavior. ; A developmental perspective encal^ges . ' " V- 
niHltigenerational and multicultural standards' (Riegel , 1972). 

_ 4. The evaluation of early childhood programs would benefit from 
a developmental perspective to guide its activities. The purposes of 
^ evaluation will then^be changed to focus on program, adult, and child 
development. This paper represents some steps towat;d^a developmental ' 
Perspective to evaluation and is far from being complete. The develop- 
mental perspective must^be considered, because of the importance of . 
evolving .valuation, strategies that, are uniquely suit.d'to early childhood 
programs, and that also share in emergent models in the general f leld of 
evaluation itself (Hamilton, et al.ri977- Willis, 1978). ■ 

' Models of Developmeot ' ' 

Katz (1975), in f'er discUsMon of earl|.^ childhood prdgrams and . 
.'ideological disputes, observed that in the formal research and evaluation 
literature th. exchang^^of divergent views concerning .what young children 
need and how these needs should be satisfied are .typically couched in : 
the. language of theory, methodoloc^^^ pd evaluation. " She argued that " 
the conflicts are hot theoretical ones, but' ideological ones related tc 
strongly h.ld concGptions of childhood, development, and the cood life. 
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in child development have pointed;: but that a major problem in the evalua- 
tion of early childhood jDrbc/rams is the failure to relate evaluatieri 
-: strategies to mtiltiple views of learning and development (Alrfiy, 1975; 
Kamii & Elliott, 1971- Kohlberg & Hayer,. 1972; Murphy, 1973-. Sfiel, 
1972).^ . : . ■ ■, . . 

. For the purposes of this paper, it is argued that the evaloator's 

idea or model. of development with its related values is reflected isi his 
design and doing of . evaluations. Models create, lenses from which certain 
phenomena are seen and o^ers excluded (Petrie, 1972). They determine 
what are considered meaningful questions for an evaluation, what methods 
of data collection and analysis will be used, how the data wTTi 'be 
interpreted, and what implications for polity are drawn. Evaluators are. 
, socialized: to certain values and models- of development as part of their 
training and to.a shared s'ense of What is. acceptable to their colleagues 
or reference groups. Evaluation involves evalua'tors-as-persons involved 
■ in netwoHs of scholarly, social, and political relationships which, in 
turn, affect 'their evaluation designs (SjoBerg, .197!3). .- . ^ 

The evaluations of Sesame Street illustrate the fact that two 
- groups of investigators with different value perspectives asked different 
questions and derived different conclusions. Ball aTid Bogatz (1970) 
accepted and used the curriculum- goals of -the program and found that . 
-Sesame Street met the goal of stimulating the growth of children who : 
. watched the show tiiore than comparable? groups, that. did not.. Cook, and his 
. associates (1975) interpreted the: goal of Sesame Street .to be a decrease 
:v ' the gap between low- and middle-income, children in terms of learning, 
arid- eencl uded that the program was not sueeessf uV in' narrowing the gap •. 
betv/een the two groups. • " . ' 
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In- agreement with Kohn's (1962) notion of scienee as ideology, a ; 
•model cannot be. judged triie or false, but only more or less useful as a 

• tnodel- from which to view reality: ." . since'no paradip ever solves " 

• all the problems it defines and since no two .paradigms leave all the 
:. same problems unsolved, paradigm debates always involve the question: 

M£!] mSera is more sj^^^ Like the issue of 

competing standards, that question of values can be answered oily in " . 
terms of criteria that lie outside of normal seienee altogetfiet, and it 
is that recQurse- to external criteria that most obviously makes paradigm 
debates revolutionary" (KuhnV 1952, pp: 108-109). 

- The argument for a developmental perspective to the evaluation of • 
early childhood programs is based in the Belief that the most significant 
^ problem for- evaluation of programs for young children _is how programs ^ 
affect their and other partieipants' (parents'and staff) full' "develop- 
ment as human. beings. Central to this argument is a consideration of ' 
alternative models' of conceptualizing development and developmental 
change. In. order to organize the, following, argument for a developtriental 
perspective to the evaluation of early childhood programs,. two models of - 
. development and their corollary assumptions as described by Reese and 
Overton- (1970; Overton & Reese. 1973;. see also Looft. 1973) will be 
dtilized as-a fpundatiofi; . ' . ; 

Reese and Overton (1970) identified two models of development in ■ - 
psyeltblogy: the organismic (active organism) am.l mechanistic" (reactive 
organism) i«)rld views. Their position. . shared by this author, is that ' 
these models reflect different ways' of looking at phenome^^^ 
ineompatiblp in their inipl ieatibns-.(see above. Kuhn, 1952). .This position' 
does not: mean -that- the. use pf .one- niDdcl procliides other? At different: 



stages in ari evaluatibh, brie of the mbdels may be jiiore useful in" 
■ " answering the questions posed. However j the integratidn of the two into 

.a common model is not possible. Both models of develbpnieht hai/e evolved 
; ■ .over time, and often are not represented in their "pure" forms. - Thtrse , - 

refinements v/nll" be noted in the cou;"5e of the discussion. 

. The mechanistic model . This model is based bh the metaphor of the 
;■• machine. Component parts and their, relationships form the reality to 
jtfhieh complex behavior ean be reduced and expressed in quantitative and 
functional relationships: ofteti called laws.. Th^ meanings of behavior 
remain constant over time. Prediction is possible arid important sfnce ' 
the knowledge of the machine at one point in time allows for "inferences 
about the state of , the machine at another point j'n time, given knowledge 
of past and potential efficient or material causes: 

Development is defined in terms of observable behaviorj- and thsDries 
bf development are extensions of learning theories'. The. epistemblogical 
position IS that of naive realism, in which the knower plays no role in 
the known, and is assumed to apprehend the v/orld in a standard way. ^ 
Thus, ^development can be assessed By how individuals measure up to 
single standards. Change occurs over time, arid does not result from 
changf^s in the structures, of the organism. V ' - 

/ The organ isni ic model . This rriodel is based on the inetaphpr of . ; 
..person as actively influencing and. shaping experience. The epistemologicnl 
position :is that of cbMstructivism^CMagoon, 1977). The knower^ in this 
-case the child, actively constructs reality (Harre, 1974-" Kami i ,1975). 
• / . V/hat is known is the product of the interaction between the active ' ' . 
' ;■ . • • ■ organfsni and the environment. Knowledge is gained only_-as the knower . 
ebristrtiets the world; ~ 

O 

ERIC 



Development Is defined as change. in the organization of a structure 
which cannot be directly observed and must be iriferrGcl from behavior. 
The relationship betv/een structure dr^'phocesses .and functions or purposes 
■ is central. The organismie model assumes qualitative change in that tfie 
meaning of behaviors change through the course of ontogenesis. Since ^ *- 
change, is the result of ft)rmal causes rather than efficient causes 
(although/effieient causes, may inhibit or facilitate change), the possi- 
bility of a strictly predictive and quantifialsle v/orld is precluded. 

The "organismie model of development has rarely been represented in - 
...^evaluations of early childhood programs, :but is pervasive in Piagetian 
preschool curricula (Kamii, 1971; 1975). In the sense tha| this' model 
is closely related to v/hat have been .f:al led qualitative (Hamilton^ 
"et'al., 1977; Willis, 1978) and cbhstrUctivist ajDproaches to educational 
r^eseareh and evaluation (Magbon, 1977), these approaches are not v/ell 
repif'esented in. evaluation in general. Educational evaluation is dominated 
by a model which focuses on products (behavior :and achievement) .over 
processes', and on quantitative "change rather than qualitative change 
(Eisner,' 1977; Levine, 1974; Partlett k Hamilton, 1976; Patton, Note 4). 
■•^^ . . Corollary Model Issues ' " ' . 

r / ^^eese and Overton (197B; Qverten & Reese, 1973) identify corollary 
model issues which affect the analysis and understanding of development. 
These issues are considered to be modelrlike or pre-theoretical and not 
■• . open to empirical test. These issues Will be described v/ith their • 

" implications for the evaluation of early-childhood programs. 

Elementarisni versus holism . The mechanistic model holds that the 
■ ' whole is predictable from its parts, that physicaTly identical elements 
have . the same "ineanina." In- contrast, tlie organismie tfiociel cohsiders 
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the person as an.org.niaed tourUy ?„ whith ti,e parts Serive »iea„i„g 
f™ the «h51e. >Re«e ana D^erton (1970) state: "Rather than assessing 
behavfor in ter„s of Saferia, Identity, this (ho1istic> assuipfion 
directs assessment In ter«s df the funcfion of the behavior in the whole 
0^ cdhte.t in «hidh it is embedded, that is, according to th. function - 
or ends,, or goals of the organise ,r part processes which are being" ^ 
investigated" :(p; 137). /" 

r This statement has several iSpHcations l^or the evaluation of early 
, childhood prograas.- particularly in the n,easuffeSent reals,, fhe i.dea ^ 
that behavior, that are physically identical do.ndt have- the sa„e «,a,i„g 
. places th. organis^ic »odel squarely in the quaiitative-pheno».ndldgical 
(Merleau=Ponty, .1362), and ethnographic traditiSn Wlson. 1977) ° ■ The ' 
pH^no^enoJogical tradition assert, that hu^an behavidr cannot be understood 
without understanding the subject's interpretation of the situation, a ■ 
position consistent with Piageti^ns (KmU, 1975). Furthermore, there 
are-™,tip1e interpretations of any given situatidn d.pehdihg upon the • 
participants and their perspectives, and the past and current social 
content of the observed behavior. The phenoMehologicat tradition also " 
intersects with the psychodySic one since both are concerned «ith 

.latent and underlying meanings in .participants' experiences. (For a 
psychoc0.na«ic perspective on curriSuium evaluation, see Tyler, 1978) 

. ■ The uie. of observational, systems 1" valuations, to'obtai^ information 
on classroom processes and behavior isHypically c.ncerneU with behavior ' ' ' 
as "facts" rather than with the Seaning of the observations in relation 
to the child, teacher, and the social milieu .of the classroo™. The need 
to.exa^inc- further how.cBildren interpret and construct their experiences :/ 
>n early education ciassrocns is highlighted by Kaflson's (cit^S ih ^ '. 



Shapi)%-, 19.73) Observations that vntfiiri a'Hontgssoh* preichoo], each ' 
child created His own eurriedlbiii; Shapiro (1973) also observed that 
children. do not have the same experiences in the same physical setting 
stieh-as the classrooni. Thus observational data on the "implementation" 
o^a certain curriculum dees not mean that all individuals within the 
setting had -the same experiences of that curriculum. The meehanistie 
model' s'psumpti on that .physical.ly identical elements have" similar 
meaning/is thus, challenged. Assessment of classroom environments and 
curricu/la hiust be redirected, in terms of how different individuals ' 
inierp^et elassrobm envirohinents and curricula '(Tyler, 1978; Hehah, 
et al.i Note 3- Takanishi & Spitzer, Note 8). Similarly, observations 
of teacher and child behavior must, be collected- and analyzed in terms of. 
their/ meaning for the participants (Magoon, 1977; Wilson, 1977}.^ 

/Moving. from observations of classroom .environments and behavior^ 
'the^holistic-elenientaristie distinction also has important implications 
for/ assessing child outcome variables in evaluations. Messiek (.1975), 
in/reviewing the status of constracts, meanings, and values in educa- - 
ti'onal research and evaluation, points out that- educational measurement 
hks been cdhcerned mainly with predictive and content Validity, and has 
egleeted an important form of validity, namely eenstruet validity. He 
emphasizes that, "the meaning of the measure must be also pondered in 
order^ to evaluate responsibly tfje possible consequences of .its proposed 
use" (p. 956). ■ ■ • ' ^ . . \ " ' ■,' 

Since intelligence, achievement, and -other standardized tests have 
been heavily Use.d in ass-essing" chi iroiitcomes in evaluations,: the feeus 
of the discussion ..will.be on these tests.as iTie_an:ingful measures. The • 
controversies surrounding ihteiligenee testinr) are well-knowni focusing • 
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on genetic and envirbninent^l factors (Jeiiseri. 1969): Attention' has also ' 
centered on the testing situation as a special setting constraining the' 
^ Child's behavior (Cazdsn. 1970-; Shapiro, 1973; Sigel. 1973). ^ers 
have challenged the predictive ^validity of intelligence and achievenient 
tests with reference to success, within and outside the educational 

■ ^ .system (Kohlberg & Mayer. 1973; Mceielland. 1373; Sigel /l972}. These 
' arguments and positions are relatively well-known' and wili not be 

eTaborated" further. . .. " . \ ' 

-. However, critiques of the testing situation have m'oved to another 
level,- namely,: inquiry into the meaning of . stanclardized assessment ^ 
situations to children^ (eicourei; et al. , 1974; Hehan, 1978; Murphy^ ' 
. 1973; Tyler. 1978). eicourei and,his associates conducted a number of - ' 
studies related to the social context of intelligence testing and ^ 

■ children's interpretative competence in the testing situation, these' 
workers found that. answers 3 uBged to bo "wrong" may result because the ■ ■ 

■ child does not share the test constructors' constructions -of correctness ' 

^. (for a similar argument, see Hessick, 1975). Validationl)f CicourelT^et 
al. C1974) findings can be found in studies conducted in' th^e Piagetian. 

^ tradition (Kainii, .1973; 1975). im standardized testing situation is ■ 
based on the assumption all children^wiTV approach the items irithe same 
-way. However, studies 'on. the meaning of standardized test items indicate- 
that a child' s "incorrect" ans^^er may result frorn a different interpretation 
of the;'t^sting niaterials CHehan. 1978).-^ Students with incotTect answers . ' 

^ were often found to be porformini the very cognitive^ operatidn being; 
tested by the questions. The assumption that low scores necessarily ^' ; ' 

. reflect lack of ability in the child, particularly when the child is a . 
member of a minori ty group; .: "It is:necessary to examine the structure • 
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of the child's aeeetiritfncj practices arid rGasom'ne processes in order to 
draw'va} id inferences about his eompeteriee" (CicbUrelj et al. ^ T974-,*. . . 

.. Another significant challenge to the assumptions of > standardized- 
isting comes from Mehan's (1978) careful "studies of videotaped testing 
situaH^ which, show that testing results are jointly pneduced through 
the child' and tes-Sr^ interactions. : Particularly in individually 

ters emphasize certain words, praise correct ' 



administered tests, te 
answers i or cujr-oU^e chi1d'--s questions, the child may ask questions 



of the tester which require him to responjci when guidelines for admims- 
tration caution against engaging in interaction v/ith the child. Test 
results are thus socially negotiated in the interactions between child 
arid tester. , . . , . ^ 

To summarize, the implications of the elenientarism-hol isifi distinction 
can. b.e found in the issue of the meaningful liess of behavioral_^ observations 
and of educationa.'l testing situations.' The distinction implies that 
observations cannot be dealt with solely 'at the level of facts, but must 
be analyzed v/ith respect to their meariincj-in-cbhtext . 'Observations of 

_ _ ft _ ^ * _ . _ _ _ _ _ ^ . 

clag'sroom life must be°analyzed in -terms of their ^meaning for the partici- 
pants (Hagoon, -1977). Educational testing, situations must^be seen as 
constructions of the test makers: which incorporate their use of language 
and values, and these constructions .may not be shared by those" being 
assessed (Almy, 1975^ Mehan, 1978; Messick,, 1975). . Thus , the vali^dity 
of the testing situations and information obtained, 'tfierein sre challenged. 

The' elementarism-holisni distinction, is also: important in relation 
te eenceptualizatiohs bf development .tn early childhood programs. Within 
the last 15- years , there has been a diversification of the curriculum 



with concommltant ekpansion of cpnceptions of children's development. A 
, Conception. of 'the "child-as-a-v/hole," however^ has the longest tradition. 
Alniy.(1975) describes; this concept as ..both emphasiziHg the uhigUeness ef 
the individual child, and the organized v/hole of physical, n;ental, and 
.social development. The concept necessitates the consideration of the 
impact of programs on all aspects of the. child's de'velbpment. 

^ These ideas can be found in arguments for "eompreHensive," molti- . 
dimensional assessment in eva^luation (Franks 1968). k magor obstacle to. 
multidimensional , assessment, 'however, is the. lack of reliable and valid ^ 
instruments in the social . and emotional domains In^ p^ Likewise, 
the focus of instrument development fias tended to be m'or'e developed' in 
.assessing what has been learned rathei" than how a person learns:' ' As . 
Zimiles (1977) has argued, a nemethetie, standardized approach. to person- 
ality . assess.nient required by large-scale evaluations that attempt cdmpre- 
hensivenesS'' is currently not feasible^ and he :suggests an idiographic 
approach to. personal ity^ assessment, likewise^, Shipnian et al. (Note 6) 
found in their intensive* ease study examination, of l^w- income. Black 
cliildreh that a given aspect of individual functioning must be evaluated 
in relation" to other aspects and in the environmental cdhditions in 
which the child was living; She too argued for a multidifnerisibnal 
assessment of individuals and:their environnientsMn ^future studies j 
since for different children, different clusters of variables appear to 
be differentially important at different points in time' (see also Sigel , 

^ . Structure-function versug antecedent-consequent . In the mechanistic 
model,, analyses' focus dn.ahtecedeht-conseqtieht relations or causes and 
effects^ .The drgahisnn'c^^ r^laM the 



..operation of • structures: and functions' ^Iri the former, the'locul of the^ 
:;- . cr1ticaT aspect of develbpinental dynamic' is external ; the organism ^ ' 
changes in response td external forces. In the latter." the: locus" is . 
: - i nterftal. to. the organism, as" structures within the organi sm change - 
. (lodfti 1973). \ . : 

. •4 ■ . In discussing meaning in evaluation, Messick (1975) arguedf "The 

■ : major point-is that. in evaluating the efficacy of programs it is ^bt 

■ ., ^ sufficient simply to. gauge the size of effetts or to appraise/ 

: outp;ut differences relative to costs, /in. addition, one should seek : 
evidehce/about the nature' and meaning of the processes that produced the 
.• effects , for an .understandinq"^ thesg ihstrumefltalities js necessary ' 
for" a -fm MSe£r>|i^^ the mlxie of the outcome " fp. 953). . A 
critical aspect of this^istinction in; the organisniic model is that ' 
• qualitatively different structures, processes, or .odes of'operatibh may 
result in the same. behavioral achievements; - ThrSonceptibh :of muhiple^ 
pathways to, similar /observed.- behavT^ is a key feature of a" qualitative 
growth model (Riegel, 1972); 

. A related value assuSption is that seme structures are""higher- • 

. ordeH- than others, , even thpugf^ each may . lead 'to the same behavior. In .' 
his critical remarks about the evaluation bf preschool Interveritions;,^ 
Slick (1968) pointed to the importance: bf making distinctions "bet^veen^ 
behavioral achievement. and the. processes or structures' 
• achievement. He argued: -It is not Enough tb simply demonstrate, that . 
-.eriterion^performance (that is; achievements) increase .with age br are ^ 
•changed by intervention.. What is necessary in order' tb make any argument ' 
:which is basic to developmental questions is tb show that the pr5cesses . 
'■ i'n<ferlyii^ the achicvem^^^ ./ " 
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. developmental level" (p.^^2l8). Glkk "suggested that the study of ' 
.' - prdcesses underlying behavioral a eduld foeus bo. transferability 

. .. of behavior and. oh .analysis of patterns: of responses in given situations. . 
. .On^ implieatfon of the structure-function/antecedent-consequ 

- distinction" is a shift away from a preOccUpatibri wi^ 
ance or Outcomes to a concern with the: processes underlying performanGeV 
This shift can also Be: eharac^terized as 5 move, from quantitative model s - 
. •- • . -.to .qualitative models of development^ a 
. . . tiohal characteristics of.. developmental change. (Wohl hill ,1973). . Z 

• ^. ■• ; • The distinction between Behavioral achievement and structure is - 

: . = : further highl-ighted -in examinations. of the relationsfiip between psycho-- ,' 
• metric and Piagetian assessments of :intelligence. DeVrfes and Kohlberg , : 

(1977) note that the: psychometric based on 

the .assuniption that assessment can be based on the npbe 

:._ ; answers the child gives; relative to other children of the sanie chrono= 

. ' * logical-age, ^e. ^ theif positiM dn^ the-normal c 

. ■ Piagetian conception views intelligence in: terms of an i 
P^lac^ in a universal , invariant sequence of dev^lbpmeh^ 
;. individuals pass at. different rates. Assessment includes hot ohly 

; ""^ight" answers, but the analysis of "wrbn^" answers and children 
reasphihg behind their answers. ; - . • . . 

.: ■ Piaget (Evans, 1973, ^cited in Dories & Kohlberg; i^^^ 

contended that intelligence tests measure performance and do not get at 

• . 'internal structures or operations. . DeVries and Kohlberg (1977). studied . ' ' 

the empirical relationship between psi'chometric and piagetian tests of 
"intelligence. . Their results indicated that Piagetian, dev^ 
;■. \ stage tests ineasUrcj sbmethihg in cbmrnbri with and are. also distinguishable 
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-frefli^chomem^J^ abilities. DeVrie^ (1974)- 

found that while Piagetian. Iq'. and aehievement tests o^empp^dii^ 
degree.. they each measured qualitatively different :aspects; of eognitive 
functioning-'^.. 

These studies indicate that the distinction between performance and 
•structures or processes is a useful one for the evaluation of early 
childhood programs. . Performance is typically measured by IQ and achieve- 
ment tests, and their predictive validity in terms of life success; has : 
been questioned (KohlBerg & Mayer, 19^3;. McClelland. 1973; Sigel:. 1^7^). . 
.'the failure to make a distinction between performance and structure is a. 
: criticaT one if the purposes of early childhood .programs are^ realk . 
aimed .at optimal' human development, rather thin increased schdol . ' - 
achievement (Kohl berg/;& Mayer. 1973).' ■ 

• • • . " ■ ^ . ■ ■ 

-' The Nature nf Bevel dpmental Change ; 

■ - ■ The nature, of Jevelopmehtal change and how that change occurs, are 
: assumptidns:(0verton'& Reese. 1973; Reese & Overton, 1978) which" can 

also be related to the evaluation of . early childhood ■programs. . These 
assumptionsVinclude whether change is conceptualized as behavioral . 
■•versus' structural , or continuous- Versus discontinuous. Additional 
assumptions are whether change occurs by unid.i recti onali^ causality 
versus reciprpcal causality or linear causality versus organized: 

- - - :- : • ' ■ 

complexity. : ■• ; . ■ ; ■ 

The nature of behavigr^l^^^as structural change . In the , • 
mfechanistit model , it is behavior or responses that change: over time. 
, -In-, the ofganismic. model, ihferrea stt^uctures. and functions change over. 

■ time; In the former models change' is' determined by^efficient or materia 
causes; in the latter, change 6ccurs ; in the structure or organisation ' 
and^f unctions as-deyelbpmeiit moves toward a gbcil or purpose. 
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Gliek (1958) argaed that the distinction betv^een the performance of 
-— — ah_acL.an^^the_capa^ perform that' act has profound: consequences 

■ for the assessment of children's development in programs. We cannot 
." .; infer from changes in performance, such as an intelligence test, that 

:- • ■ . the underlying cognitive structure or ability has changed. Zi.gler and 
Butterfield:U968) demonstrated that the Bin 

chfi'dren varied by a mean of 10 points depending upon whether the child 
/•.was tested tinder. standard.,testing conditions or under conditions designed • 

■ "to make the child comfortable and thus to obtain his optimal level of 

. • .: V . performance: Z°igler and Butterfield compared standard. and optimal forms.. 

- pf IQ testing. on children prior to pntering a. preschool program and _ 
.;. seven months later. They found that while tested IQ showed a rise. 

during..the.year^ optimal IQ scores did not. .Other researchers have-also" 
;■ .pointed to the importance of the distinction between performance in the . 
standardized testing situation and tfiGvChild's capacity to. perform in 
: ' V '/c)they^ situations (Cazdeh, 1970|: Cicourel et al. , 1974*; McGlellarid, - 

„ 1973- :Murphy, 1973; Shapiro, 1973). Accordingly, theTocus of attention 
- ^ moves from '-gains" in scores to the underlying structures. " 

. Continuous versus discontinuous change . Integrally related to the " 
behavioral change-strUctUral change dimension is 'v/heifcier developmental 
G|iarige is contiodous or discontinuous. Mechanistic models are, characterized 
■ . by notions Of -contiriuous, additive^ .linear Chajige. Orpnismitr modeU ' / 
. ■ . assunie\di5contTnuity in." development. ♦ (Looft (1973) n^tes that continuity- . 
is part of an organismic approach in a derivative'sense. ) Since dhange 

■ in the organization of parts Results in-, an emergent system, change 
canriat. be predicted, from :kflowlgdge of the parts.. * 

■ ^ ■ . ■.. 
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• ' ^t^^^ectional caiisaHtv vpr.-Hc ceeigrocal cau^^lify? - ' i^^c. and 
. Overtbn (1973) distingoisli between unidirectional :caosality in whiGh the 
.^effect IS dependent upon|some extef-nal cause versus reciprocal causality 
in which, both the enviropeht and the organism affect each ether'in an 
ongoing manner. 

• Linear causalit^rsus uraa nized rnmpi^^ifu a meehanistic -moder. 
assumes there IS. a linear relationship between a cause and an effect, 
individual causes- are additive in. their effects, and that • cassation is 
unidirectional. ' .However^ a developmmaU^^^ takes as its' 

explahation the. idea of organized complexity, that is, changes m the ^ 
organization of the parts. „ In light of reciprocal; c^ and organized 

•complexity, explanation of developmental changers not possible in terms . 
•of efficient br material causes.^ What might facilitate development in' ' 
one person m^ not operati simi.larly for another. The. idea of organized " 
eompl^xity is also inclusive of cultural , -socioeconomic, and regional " 
dp.f ^fences -in development. " ^ . . 

: • I^Sel (i972);:described change as organized complexity resulting - 
f rom.|reschool intervention programs, The child is cdmpesecl of a variety , 
of s|^ysterns (pereaptual, cognitive., emotiorial, .etc. ) whose relationships 
to. e|^h other vary over time. Change in on^ subsystem is'related to 
changes in; others. Sigel noted that even though deveiopment is overall ^ 
, a cunipiativr process. Vtbe cumulatiye effect ^m^ itself in ' ■ 

various effect^ at.different times" (p.,.35g); The distinctions regarding.-: 
the nature, of developmental change' have profound implications for the 
•evaluation ^dfeanly^.education programs. Evaluation of early childhood : 
•prpgrams,' almost without exception, exhibit a unidirectional bias in •• ■ 
which , the program is^. viewe^l as the "treatment" which;" causes some chsinge^ 



in the child, this uhidireetidrial. bias is often, roefiected in discussibhs 
■ of- the "pred-itti've v.alfdity" of a prograrn.. The cdniplexities involved in 
such prediction are highlighted by Shiphiah et ah (Note 6) who caution 
that "the prediction of a child's achievement from early indices of the 
hoiiie. erivirohment should not be .interpreted to mean that these, predictors .' 

necesprny~"?ettrwr^^ Eamii'es.,_ihlldrenj,-a^^ 

schools,. can and do change^ with corresponding change in the. nature o.f 
. thefr interactions, .and such change, can be faci.Titative dr° harmful" 
. (pp. 48-49; see Sigel (1972) for a similar argumen 

If one takes a deveLopmental perspective, there is much "less ' ■ - 
; concern with prediction of later' behavior, given^ pltiple, interacting, 
and conflicting, influences .on behavior. Based on her own longitudinaT. 
studies (Murphy, 1962) and those at the Fnstitute of Human Development . • 
.. (Jones,. Bay ley, Macfarlane,__:& Ronzifc, 1971}, Murphy (1973) stated,' "t1 a 
l9rge,extent, each child's development is'.a mystery story whose outcome" ' 
we cannot . really predict", (p, 344). . Jones et al. .(1971), iK their. - ' 
studies of the physical, prital, emotional ,. and social development of 
individuals, point te the difficulty in predicting in these areasj and : 
stress ^^he individuality .and plasticity -of growth patterns;. In a recent .' 
publication based on the Berkeley Growth Study data, McGall, EichorHi 
and Hogarty (1977), conceptualized change' in 'mental development as ' ' 
reflecting periods of instability of individual differences and/or, 
dis.continuit.ies. in deve-lopinsntal function across age. • Tlie 'eniphasi.s of 
their study was on locating and describing; deve'lopinental change and • • 
transition, not continuity, and stability. r 

The best, arid perhap.s only, exiimple of the complexities" involved in 
prediction from preschobl iritervehtiori programs is the Shipirian 'et al. ' •■ 



: (Note 5) CiEise studies of. Idw-iricdrne Black children who v/ere participating 
'in the. ETS-Head Start- longTUidinal study. " Giveh the dynarhic interrela- 
tions among physical, affective^ sbeiaV, and eeghitive development,; • ■ 
Shipman arid her eolleagues concluded it. is extremely difficult to predict 
Whether a child who is doing well in Head Start will cbritiriiie to do so 
in his. later eleinentary school years, or whether a chi ld who- is doing • 
badly will continue to have problems .iri;.later life. The Shipman et al. ■■ 
ebrieltisions, are supported by those~ofTrthBTv-lonf-i-t-udi^M^^ 
1962; Jonds et al, 1971). Given the complexities involved, a develojamental 
perispective, to evalu^.tion needs to be reoriented 'toward description' and 
Understanding (Strike, 1972) and toward concurrent, contemporary validity.; 
(Rceall, ^1977) rather) than prediction. McCalTs distinction between the . 
continuity/discontinuity of developmental functions and the "stability/ •■ 
instability of individual differences" requif-es closer attention in 
longitudinal studies. _ " ,. : ^ . ' 

■. . the evaluation of early childhood. programs could benefit from a , ■ 
reciprocal causation perspective in which iiotii children and their eriviron- 
iherits are viewed as changing ovir time (Riegel , 1972; ;Saineroff, 1975). 
S.. White (Kilmer & Weinberg, 1974)-argugd for a cdhceptualization 0f-;the . 
child, as capable of maki^ng "multiple cognitive adaptations to (a variety • 
of) cdritextual specific demands" (p. 61). ' A' reciprocal . causality" approach 
is sugge.sted by Shapiro's (1973) discussion of how children in early" . 
education programs "construct" their own curriculum within the ...program. 
Through the child's^ own activity: and interpretation, a diff Brent "treat- 
ment" can be said to exist for different children in the program, resulting, 
in a variety of outcomes for different children (Zimiles, 1977); 



■ • iriipii cations for, assessing ppbgram effectivenes s. A cieve.loprnental 
•perspective tb-evaioatien . accepts the idea that there are serious Tifriitatibris 
.to proving the "effectiveness" of early childhood programs, Furtherfnore,. • 
this perspective rejects sn efficient cause apprdach to studying program ,• 
impact; There are other difficulties in prbving that otir prbgraffis are 
effective (McCall, 1977). Most of the evaluation studied are correlational: , 
and causality cannot be inferred. Even in those projects; which are 
— ^expew^me.1^^ n]ors_^trict_ eon;trbl and mbnitbring than the 

majority of programs; other limitations are preseritT^Tiller^Tsre^ — 
pathways , to ajiy observed outcofne. Just because we are a'ble to demonstrate 
that a program was effective in terms of certain oiitcdmes., v/e cannot 
prove that- the results were due to the program per se. Positive results, 
based on one prograim, also cannot be generalized to other programs in . . 
. other' communities :(Crdnbach, 1974). One^example is. the recent publication 
of the much sought-after,- positive results of . infant and preschool 
intervention projects (Lazar, et a>. , 1977). The findings were based on . 
14 experimental programs with -'defli berate cognitive curricula". (Lazar et ^ 
al. , 1977,. p. 2). Many of the programs were- university-abased and small'^^ 
in scale-, and received closer control and supervision than. most early; . 
childhood programs. . V . - ■* 

. Another challenge to general izability of; program effectf has been 
raised^ -By .Rouse and his colleagues in their critique- of tlie '|bt" Assbciates' . 
evaluation of Planned Variati^jn Follow Through. House^ 61Iss^.;HcLean, 
arid :V/alker (1978) stressed the importance of "Tpcal individUl i ty/' 
(p. 474), -meaning that models .that v/orked well in brie eomfh unity [Worked, 
poorly im another. Theyrargued that local setting variables (individual 
te'schers,, schoolsj neighborhoods, homes) had nidre ef|ect- on achievement 
than did the labelled riibdels. . . ■ ^ - ^ ; . . 
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Ttese reservations will raise the wratfi of . sonie of my colleagues - 
who will undo^jbtedly accuse me of joining the. ranks. of Jensen^ Herrnstein, 
Eyehtk, and others whd do not ::have mUeh faith in the results bf Fleadstart 
and oth^r. early childhdod prbgrams. I will f robably be accused of 
•■making statements detrimental -to the future funding of early chilcjhoJDd 

programs just when we appear to have evidente of Ibng^term effects. 

.■ . . * . _ " ■ , -. ■ -- ■ . - \ 

tlence^- these comments. -aj^ fii^de with tineertainty and regret. There4is, ^ \ 

* r ■ • . . ■ ■ v ■ . ■ \ 

however, a hopeful side to niy obsp.rVatlqns. A .developmental .perspec-tive' ' 
to evaluation With its diniensions of ^reciprocal causality and drganlzed / 
complexity discussed Tearli-er^s^^ for long-^term • 



effects of'programs is illusionary. In the Tinear-unidirectionar causa- , 
tion model j the preschoo:! interventio;!! program^' often conceived of as 
the "treatment," is assumed to affect a child's develbpinent as. a' significant 
main effect and have persistent effects later in the child's life. 
Koocher and Broskov/ski (1977) have, ^labeled ^his mode of. thinking as "the - 
islngle^input fallacy" (p. 584). Assessnient of ptogram impact must take 
into account multiple and competing influences on t^ child during the 
program and in the period of ^iime after the. program ends 'and the follow-up 
study begins. When the child is in the program and in the intervening 
years,- she is' exposed to multiple socialliirig influences, rnany^ of . which . 

we are not able to {and; possibly shou'ld not) control. Concerns over 

. - * ' ^ ■ . . ■ ' - ■ ^- 

'^fadeout" or maintenance of "gains" are considerably dlniinislied. 

I am aware thH committed -advocates of early childhood programs ■ 
strongly be.l;ieve that they must demonstrate the long-term effectiyeness 
of preschool intervention (often without" knov/ing hot/ programs; function^ 
and:Why effects- are observed) before public monies v/ill .flow again. But " ' - 
I Hbuld argue as. advocates for young children, v/e. have gotten ourselves - 



In a pectjliar situcition. We. are* not in a po'sitidn frm a research arid" 

; .a . ■ - « ; . 

. an evaluation stance to demonstrate tlie long- term, effectiveness of any- 
. early, childhood prdgram. the jar es timed demands o-f the policy makers 

• outstrip, the state of the art inmethodSj -instruments, and resources 
(Zimiles, 1977). Vet we persist in doing so, because :we think that is 
the kind ot information jDdl ley makers' want.' ^ - Perhaps this, question 
reflects my limited experience and naivete, but why do we try to build 
up Expectations that we know wtTl go unmet? V/hy. not say We. cannot at 

• ' present demonstrate effectiveness', and that wevshouldvhave .prograiiis for 
"Children for certain desirabTe social; goals artd values^ ; and not because 

the evaluations say we should? 'Perhaps part of. the answer Ties ,in the- 
tendency of American social scientists to believe that the demonstration 
orTfrr^ffettiveness-lDf^e^^ imminently possibTe and "that 

, policy decisions v/ill be made -in a ratTDnaT7~?ystemat4c~man;^^^ 
; ' 1978). . 0 . ■ . " " 

..... : - . . , ■ . V . j> t c 

We should take cognizance Of the conclusions 'of "a number of 
contributors te Weiss' (1977) volume Using / -Social. 'Research in Publi/ 
teliey Making that evaluation findings remain- only one seuree of inf/^ma-' 

• tion for decision, makers; Ethical , legal ^ economic, and politi-ca/l " 
ct)nsiderations are also 'imjDortant factors in decision making.i/Datta'a 
(1975) detailed account of the impact of thg W^stinghdUse/Ohio evaluation-, 
on . .the developnient of Mead 'Sta.rt confirms the. importance/of these factors 
and their complex, often' unpredictable: i'nterrelatioHsHips. - ' ' 

P rpliminaries lto^ developmental pGrspectiye to- evaluatioh ." 
.. Ross and Cronbach (1976) -state that ''whaV^^ 
wliat view of the. pdl itical 'system, or whnt^sumptions about the purposes 
of evalurttien lead to each. of the diverg^liit positions taken by-; eValUators, 
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researehers, . and decisis (p. ig); JKe Gp1stemoi.6gicar ' " 

stance, has already been" discussed iH the p^esentatTons of alternative. 
. • ,.:.niodels of development. What i s bei ng pnoposed here is a ratidriale for 
■ • working toward a developmental perspective, which reprasonts a closer, • 
match^ between evaTuation 'strategies and the phenomen9 under study. ■ I aim 
not yet .ready to present this perspective in great detail at this point,-- 
but will ^share seme of my thoughts-in.-fdrmatiori. ■ In this section, views 
■■ o.f-^the:p.olitidal system and assumptions: about th§ : purposes df'.evaUiatidn 
enter into a rationale: for a dav^lopmentai- perspective to evaluation 'of 
- :early^el5i;ldhbod programs; In all' my cohsideratiojis, I -have been guided 
by-Albert:Einsein's statement: "A perfection of itieans and confusion of 
aims seems to be our main prbbJem." . - . • - 

' What Sre the Pfirpose s^of ah -Early J^hildhood Evaluation ? " 

The question of the purposes of an eValuatienis critical because 
~-ptjr-po5es__siiape the designV instrumentation, and interpretation of m ■ ' 
evaluation (Messick. 197% . If. for Example, ;^ the pdrpose of an! early 
childhood- program i.s to increase, school achievement and iq test scores, 
then, an evaluation may be desigfied to assess' them easily. 'Hov/ever,. a v 
number of .early educators have argued that .ihcreases in .school achievement 
and in perforniahce on I^ests are "not the purpdse of early' chi Idhobd .' • 
programs (Kamri, 19'73^), particularly of programs that^are not aimed . 
toward achievement in the schoolrsense (Kof]lberg & Mayer, 1973). Hehee, * 
standardized tests are not appropriate.. ' ■ .. 

Frbm-the niodels of. development presented in the previous section/ "l 
•it follows that a develbpniehtal. perspective to evaliiation is not primarily 
Goncerned^with achievement tfatai" Oh the contrary, the purposes of ■ 
evaluation ef early, childhood programs are direeted^' toward, involving the 
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•.participants, ihcluding the evaluatprg,.'in uriderstandi tig program develop-;. 

ment/ atiult (staff arid' parehit} development, and child development. . 

■Evaluation is directed toward enabling all involved j'n the program to ^-y 
■.reflect critically about what is- happening- (Carini , 1975^ Eisner, 1977; ■ . 
: .Cronbach, 1974; Partlet.t.& Hamilton, 1976)-. Thas evaluation is geared : .. 

toward providing feedbacR fibeut the program to the staff and other .aud.iences 

- - .- - ■ -. 6. 

in terms that are coniprehensible and whieh-lead to more sound practices. 
The most important criterion against which" an. evaluation is judged is 
its utality, or the extent to which the evaluation resuUi in program- 
improyement and c'liild development. ■ • ; • ^ ; 

- ■ A related ci^iteri on for an^valuation .is the degree to . which it- 
^ enhances the develdp^rit of all participants 'and their dignity as human . ; 
beings (Sjoberg, 1975;NTyler, :1978): Thus, considerable attention 
shotild be focused Vn-hpw' evaluation is actually practiced and h6w. it . " 
affects the partieijiants': self-esteem CReport 6f the Tayk- Force pn 
Testing and. Assessment of eiiildren.,- 1976/, Tyl-^ 

• A developmentaT perspective to the evaluation of progy-ams is eempat- 
■ me with mere formative modes of evaluation,; and With an "extende.d" view : 



of ^evaluation described by Ross and Gronbach (1975). Evaluation is-seen 
as a continuing part of program management and planning. This view i5 ■ 
also consistent with Public Law (PL.) 9^53 of the Community .Mental 
Health Centers (CHHC). Amsndffients of 1975 (Davis, Windle, S SHarf stein, 
1977; Guidelines for Program Evaluation in-CMHCs, 1977) whicb obligates . , 
Veaerally funded' community mental health centers to conduct program 
.evaluations on .an engding basis to improve services and to be more 
responsive to clients; ; The evalUator i% part of the program; s'he. studies 
what was delivered and how people interacted during, the prog.ram-^ The 
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eyaliiatdr functions as a naturalistic observer v/hose inquiry grows out 
^ His/her- observat ions . Thespst/ategi es are- also compati bl e wi th .a 

■ qua! i tative, approach t^^ evaluation (Eisner » 1977- Hamilton -et al. . 1977:' ^ 
Stake, 1967; Willqn, l|pr VHl lis,,; 3:978; Wolf & Tymitz, 1977; Ca^bell, ; 

•Note i). . • . ' '■■ ■ - ' ' 

A developmental pers pective, to 4he the evaluation -tff programs . In-: 

• eyaltjations based on the experimental paradip,. programs are ''treatments'! 

which are^ass.umed to be similar across sites and which can be replicated 

ITS other sites. This cenceptueil ization of sprografns 1s based on the 
VT-\ --- - ■ - ■ ■ - V o ■ ' ■ ■■ . ' 

Ideal of general izable ^knowledge (Cronbach, 1975).' .HoWeVer- large-^seale. 

evaluations. of early childhood programs indicate that- the assumption. 

■ that programs, can be treated ai a set of unitary variables is questionable 
" House, Glass, Mebearl. arid V/^lker (1978) point to local setting Variables 
•3s' mp^re important in determining achievement scores ihan the labelled 

■ - ■ ■-- ■ ■-' - : ,- - - " - ■ ■ - . . • 

program models in Project Follow Through. : .. ' • 

. Ah alternative eoneeptual ization is programs-as-cultural . systems • 
(in contrast to. programs-as-treatments) with histories, traditions, arid - ■ 
values. The anthropologist Clifford Geertz (1973) has aptly expressed 
the' distinction I am making: ■ "The concept of culture I espouse v . : is 
essentially a semiotic one. Believing, with Max Weber, that man is an 
animal suspended in webs of significance he himself has spun, I take 
cultu-f-e to be those webs, and, the" analysis of i| to -be therefore 'not an 
experimental science: i^,, search of law but an; interpretative one in- ' . " ' 
's&arcb xxX meaning " '(p. 5).; Of central interest in. evaluations of pi-ograms ' 
would be how children and adults ..structure fiieariing out of'their experiences 
arid create the daily routirie of . progranr;.tife~"(see,'''W^^ Mehan^ 



interpretatiOFis of .what the program /s (Hanillton, et al. ^ 1977). Methods 
- fi3r studying programs-.as-cunwrey^ay include ("Ramnton, ' 

etal., 1977; MacDonald & Walker, 1975; Stake, 1978), ethnographic 
approaches (Mehan, 1978; MehanVet/al. , Note 3); documentation. (Carini, 
1975; Kami Hon &: Partlett, l976)7among others in J rich, emerging area' 
' (Willis, 1978), ^ ; ■ . / - . . • ' 

; ■ A de^slopmental^perspe^^^ also concerned with the study of ^ 
programs and classroom environments , in" terms of their change over time. 
GUtteritag (1977) articulated this idea: . "Given' the nature of most 
sdcial programs, it is not realistic: to presume that they can be kept 
. the.,same over time . . . . When evaluators act , as though the program 
was. indeed unchanging over time, it is nearly always a fiction. Results". • ." 
based op such seemingly ' unchaiiging' programs.: are hard td believe, and 
may lead to false inferences'" (p. 19).^ i . . .' ■ 

^M^st studies of classroom environment^^^^ " 
^hange overtime, such as the school year. However, people who are 
involve-d-^'th early childhood programs know that there are forces for ■ 
change--bpth improvement and regression. Programs rarely remain stat.ic- ■ 
• entiti^es. For example, in Weikart's. (1972) Ypsil^nti Project, .there was • : 
continuous .opportunity for improvement and' change in v/hat teachers were 
doing in^their elissrbbnis. . A" develbpmental perspective is sensitive tp 
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'■; important to the precision of eaHy.chilcfhoea programs and sfeuld be \ 
■systeimically exanjined in future. evaluati^^^^ 

V: ..Katr (1971; 1973; 1977) has outlined some problems in the sociology ' 
^ .of.Garly chndhood education which tak^^ account the social arid ■ / 
. ^political context ;in which early chfldhbod educators work. The effects' 
. ;of mandated, often shifting program requirements, and the conditions of : 
; ..the work Place, partrcularl^r the special problems/involved in Wot-kihg 

witfi young children (Katz.. 1971; 1977) should be examined in' evaluations. . 
Developmental stages of preschool teachers (Katz, 1972j",^ight be applied 
■ to. looking at staff development in'-programs; ; Wei kart (1972) argued that ■ 
teacher motivatipri. supervision, and resourceful riess. appear to be particu- 
larly important in program operations. , He' argued that any project must ' 
have an effective staff Ml which includes high intensity of planning . 
and supervision. * : . • . 

^ Another potential area for evaluatio^ is how. early educators a ; 
^ and use developmental theories and research., and^curriculum and. instruc- 
tional materials,. This kind of examination challenges the taken-for^ 
grantee! assumption that,research can provide suggestions how to tfeach by 
the translation of child development research into eurriculun, (Katz. 
1973). Jackson , and Kieslar (1977) have^^^^^^ 

linear approach to the relation between resear-ch and.nr.Pt^^c- . tk... 
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^;ecirly educatbrs , is important in ancJ--. standing hov/ programs develop over, 
time, arid is an important component of qualitative evaluations of educa- 
tiorial innovations (Magponi. 1977). 

A developmental pirspective to evaluation would also focus seriously 
on Understanding parental and family development in early childhood 
programs. Reviews of the effects of intervention programs identify the 
importance of the mother's teaching style and attitudes, and her role in 
"maintaining gains:" of the programs (Bronfenbrenrter, .1973; Shipman et ' ^ 
al . , 1975). SigeT (1972) pointed to iBe 'importance^of considering. ' 
changes. in the .child as a -result bf the program in relation to changes * 
in the befravidr and attitudes of th Mothers are' reported to^ 

go. back to work and school and to be involved in community life as a 
result of their chJldren's pafticipatidn in the program. Yet our knowledge 
of ' the relationships betwee^^^ early childhood programs atid parerital and 
family development remains supplemental in most. -evaluations^ often 
treated as anecdotal * asides ■(see^. hpweveri Falender & Heber., 1975'; 
Slaughter, Note 7). ^ ■ - . ■ ■ ' ■ 

Evaluations in. this area should not focus solely , on parental behavibr 
vis-a--vis the. child,- but also on parents as persons v/ith their own needs 
and. interests. Research , on: parentfiddd as a developmental stage (Benedek, 
1959;- Leifer, 1977) provides some' GbnGepts' for. examining the adaptations 
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■ ■ " ' A developmental pBcspectt ve to assessing ehildrajj ; It is staking ' 
■ that in tfie^ many evaluations of early ehildhood- programs,; many of which ■ 
are in, operation for the same children over a number. of years, that we 
■ know very little about how 4ndividual children develop: in these' programs. ^ 
. AUhoUgh staff talk a great deal about how individual children develop 

In their programs, we have few descriptive, longitudinal- records of . 
assessment of change over age within individuals. There are two. reasons 
why more attention shouldbe placed on the child as the unit of analysis. 
. If 6ne of the. goals of early childhood programs is. to enhance the child's 
life chances,, then the individual is the appropriate unit ,of analysis. 
. ^Furthermore, in longitudinal studies, the only unit that has continuity 
over time is the individual child (Haney^ 

need for individualdeVelopmental histor^esof children in programs like 
thoseconstructed ia the Berkeley Growth St^ Bayley. Macfarlane, 

. & Honzik, l?7i) and Murphy's (1962) studies of the topeka children^ i 
Shipman et al. . (Note 6). intensive case studies f& the ETS- Head Wart ^ 

• longitudinal sample augur well for the future. . J" ' . > ■ . . ; 

.. The importance of .longitudinal studies has^becm 1-Ltified by many. 

• wdrkers-in the field (Lazar et al., 1977;. Shipman,: 197||igel. Secrist, 

• ' & Forfnan-1972;..5hipman. et ali. ..'Note 6). .Howev^r.l fui|ental prbblems ' 
„ of how development and change v/ilT be:coneeptuali2ed inferise longitudinal ' 
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Ibngittidinal. studies. are relatively rare and remain an underdeveloped 
field both in conceptual izatioh^and methedoTegy (McCall, 1977- V/ohlhil 1 ^ 



Serve ? ' ■ • • • . 

; Related to the, question of the purposes of an evaluation is the . 
issue of whom the ivalUatibn should serve. Sjoberg. (1975) charged that 
evaluators usually align themselves with the powerful , or dominant groups 
in the system and accept these. groups' definitions bf.progrp goals and 
desired outcomes. Thus evaluation serves several functions .including 
reform, manipulation, .and sustaining power or structural relations. 
Sjoberg argues for a. countersystem. r'ole. in which the evaluator works 
with the less powerful in the system. .Iii a s-imilar -vein, ^ House argues ■ 
for justice-as-fairness as an important .standard for evaluation.. :'"§y 
the second. principle (of justice), 'social and ecoDomie inequalities must 
benefit the least advantaged in the long run. The educationally least 
advantaged within most "settings: are the chil dren f i rst and the teachers 
second. The eva l uator siiould strive to present their views and 
perspecti ves " {p. 97). ; ; ■ . : ' . 

In early childhood programs, staff and parents have a . particular 
• stake in the program arid its services. .They are the' individuals who are 
actively involved, in "implementing- the program. If evaluation is .to have 
utility^ these individuals must be participants in the Drohp's.n.-^ fin. 
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' arid support individual, rights^ facilitate growth and enhance dignity" 
ip. 17). its ^'Statement of Rights^' for Children, parents^ and staff can 
be found in Appendix I. ... 

It should be clear by now that my bias in arguing for a develop- 
mental perspective is that 'the sdl^ purpose of evaluation is not oriented 
toward- judgment of. the. effectiveness or efficiency bf.a program or 
toward the perceived needs'of public policy makers for quantitative, 
"hard" data basecl.on large samples of children. In factj serious challenges 
have been raised about the evaluator-s assumption that gvaluations 
provide information for decision makers (Weiss, 1977; Note 9). 

Others have pointed to the limitations of large-scale survey research 
for policy making (Rehan, 1978). Findings f rdin^ jarge-scaTe studies are 
probabilistic and do not apply to particular programs. They rarely^ ; 
reveal much about the processes which create and maintain, programs, and 
hence are limited in identifying specif ic '"actions for change. Finally, 
since" the findings are abstract rather than concrete, motivating staff 
concern for improvjement i§ understandably difficult. 

• the purposes. of evaluation are based on -'^louSG's (1975) notions of 
justice, in evaTtiation and areV oriented toward program develbpnient. arid 
serving needs of the staff and children, not primarily the bureaucratie: 
arid funding agericies: These, purposes also reflect changing conceptions 

^nr\ riT wisr^cT f iVaf T nn f\f owaln^fif^n ArtTv/ifv in +Hfa ^7n<; toward nrrinranl . 



^inquiry. . We have tnany mares,opt"ions fn evaluating early . childhood 
programs than v/e are currently utilizing (Perrone, Gohen, & Martin, 
• Note 5). Explorations of alternatives will allov/ us to see mvi problems 
invent new methods, and to„understand our programs in ways that better: 
f-it our. experiences- of the complexities of program life and, of adult and 
chil'd development;.' ■ . 

Constraiht^ on .a Developme ntal Perspective ' 

An argument for a devel,.opmental perspective to evaluation of early 
childhood programs has been, presented; There are, however, a.,nufnber. of 
constraints on the farther development of this perspective. One major 
constraint is that research in child development has itself neglected a 
developmental orientation C^fcGall| 1977; Woh1hi.ll, 1973^. Furtfiemiore, 
there has been an' emphasis on. concepts of stability, continuity, and 
equilibrium over those of instability, discontinuity, and change in 
; longftudinal research (Riegel, 1972; 1976; ReGall, Eichorn, & Hogarty, . ' 
1977; Wohlhill," 19-73). Thus, a conceptual and methodological ' base for 
a developmental perspective is underdeveloped'. 
.• Another critical constraint is that- a developmental perspective 
to evaluatidh represents assumptions and ideologies which are. gaining 
ascendance, bat which are still overshadowed by what have been variously 
■ . called quantitcitive or experimental approaches to "eval nation.- This 
• paper posited earlier that. paradigms of aval uation represent views, of 
reality arid tlie selection of one over another is-a matter of values.' 
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■ Levine (1974), anfong others, observes that .science is soelally. 
constructed, by a cdnim unity: -"Science is v/hat scientists feel comfortable 
in reeoninieneling to. others as principles through which the world may be ' 
manipulated, pr^edictedj or understood, "Science is what scientists say 
it is at any given point in time.- Science is what sciervfists feel 
■ ^comfortable in .writing about in articles and in textbooks" (p." 669). 

Developmental perspectives to evaluation which are akin to qUalita- 
tivej ethnographic, and naturalistic approaches to evaluation are weak 
in Cdmparisdh to t fie dominant model , lack a strong and 'sizable community 
of committed workers, and suffer from°;the lack of legitimation. Strategies 
for creating parity and tolerance are needed simultaneously with further 
work on a developmental perspective. Ressick (1975) offers Churchman's 
proposals for the study of systems of inquiry that can-aid in the.expcisUre 
of the implicit value assumptions in research. strategies.. : Levi ne (1974) 
suggests an adversary mod^l. Meanwhilei one constraint on the further 
development of a developmental iDersp.ective is the dominance of the 
experimental and psychometric models. .■ . '% 

But there is ah eVen more trbUbl.esome constraint related to complex, 
issues in the ethics ef evaluation studies. Evaluations/that aim at.the 
intensive documentation of program life and at the interpretative under- 
standings of the participants may be too revealing.. These evaluations 
may unmask the protective myths surrounding early childhood programs.. 
Quantitative methods, by' their .very nature^.do not have the pbteritiat ef 
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Given these very significant and pov/erf til constraints , individuals 
Who are involved in the evaluation of .early childhood prograins face a 
major reconsideration af their purposes and methods. Moving toward a 
.developmental perspective calls for a reorientation in many of the Ways 
evaluation is currently practiced and supported. In this paper,, I have 
aspired to lay the groundwork for an evaluation model that is grounded 
in knowledge of the traditions, problems-, and practicing realities of 

early child-hood programs and which in all its considerations places ° 

■ - ^ ' ' ■ I ■ • 1 

ideas of develop meflt as the center of inquiry.; In reflecting on the 

need for and future work on a deveTdpmental perslDectivG, I am encouraged 

by John, Tukey's observation: "Far better an approximate answer to the 

right question, which is oft^n vague, than an exact answer tO; the v/rong 

questions;' v/hich can always be^made precise'^ (cited in Rose, 1977, 

p. 23). ; . : ;. ■ . ^ / - 
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Footnotes ' 

• "^A version bf this pap^was presented at the annual meeting of the 
American Educational Research Association, Toronto, Canada, March 28, 
1978. ; . \ ' . / 

• ^Ecdndmic and political ideologies have influenced the. concept of . 
development in American develbpniental psychology .(Riegel ^ 1972). . Riegel 
contended that quantitative, model s* are associated with the "capitalistic 
orientatioh of the Ahglo-American countries, and represent continuous 
growth models' in which all . individuals are- evaluated against single 
standards. The "mercentalistic-soGialistic" orientation .of the European 
continent is represented by qualitative models which focus dri the prgani 
zatibn and structure of experiences and which evaluate. individuals 
according to multiple stlndards- Detailed analyses of the ideological _ 
and. phildsdphical underpinnings of models of development have been,.- 
described elsewhere (Riegel , 1972; Kvalg, 1973, 1976) and will not be 
covered here. . : 

, Pinar^s (1978) essay on currere , the analysis of the individual's 
lived experience of a curriculum, - richly "expands on the ideas expressed 
here.\; • . - v ■ ; 

^For ah excellent arid detailed discussiGhd this research, see 
Mehan (1978),*ppi 49-56. . ' • . ■ 

^A problem worthy of carfeful consideratiori is what kinds of 
infdrmatidri pdl icy makers want about early chiTdhood programs. The 
fbetjs bri "child outcomes, specifically measured by .Intelligence and 
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other early ihterveritibn programs) are based solely on cognitive oatcbmes; 
However, there, is cbnsiderable agreement that Head Start "v/orks" in 
.areas related to health sereening and treatment^ nutrition^, and parent . 
and community participation. Head Start, serves as a potential model for 
the. cbbrdi nation of child and. family services; This coordination of 
services was, in fact, a major thrust of its original mission (Datta, 

1976). : ' ; ; V . ^ ^ ^ ; 

. %or an extended discussion of this point, see Stake (1978)." 
.^Existing Taws (PL 94-142 and PL 93-380) require that certain 
programs determine their impact on individual children. According to : 
PL 94^142, teachers -must evaluate the^ Qhild^s progress according to the 
Individualized Educationaf P^ ■ ^ 

. : g . ^ ■ . . . : ; .... • • . _ _ 

I recognize that youhg children must also, be considered as. partiei- 
pahts in evaluations, but am not ready to deal with this problem in 
depth at this time; 

For an excellent, integrative review of decl ining faith in mainstream 
social science^ see Skinner (1978). - . 
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APPENDIX I 



V. CONCLUSIOM. 



This Task Force has ebrisidered a range of issues regarding assessment: 
need, proce^s.^ qse^ 'and impaet, in .the body of this paper. ^ In reviewing 
the need for assessment^ the Task Force^ recognizes that assessment of 
specific developmental^ processes in yqung children is an established^and- 
.necessary practice. The challenge for those who work with children 1s 
to util ize assessment methods which . recoi^nize and support individual 
ri^jrts* faci li tate orowth, and enhanEI~dignity . . 

After exploring the process ariduse of assessment, the Task Force has 
agreed^that'.there is a'wide variation in the quality of assessment 
methods available .for .t^e- wit Therefor^, eare must be 

taken in :the selection "of inst^ provide 
useful information for planning educational opportunities/ 

Firially, the Task Force recognizes that the effect of the assessment 
process ;on a chil(|*s family is a criti-caTly important factor^, and must 
be taken into coriHderatibri at each step in that process. The Task 
Force members hax^e seriously studied^ tfrese issues, and as a result of 
their efforts, have developed a^ -5^gtemwt of Rights for children, parents, 
and: staff as the bl uepri nt_. for i nip 1 ementati on in any program/ serving. _ 
young children and their f*amilies>^ Althod^gh parents^a staff fulfill' 
the rqle of advocates for children's rights, they also have rights in 
this regard . \ : - 

This Task. Force recommends that all prdgrams for young children adopt . 
the following Statement of Rights : ' ~ . 



* . * " Rights of the. Child ' 

A child has- the right 'to be different^ and to be accepted as such. . . 
Differences in individual children should be approached in a posi-tivei 
meahiDgfuT way so they may function. ta their fullest capacity in a 
pluralistic society. 

•A child has the right to.be assessed, and as a result through an assess- 
ment, to be provided v/ith a quality, developmental program. 

A child has the. right to be tested under optimal conditions :in a* non- 
threatening environment by a person sensitive to children. 
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• A child has the right to be assessed .wtth^a npnbiased instrument by a 
person who speaks the language' iri which -tlie^chjj^^^^ fluent. 

A child who" scores differently from the norm. on any given test or assess- 
ment has the right not to be labeled.. -^ 

A. child has the night to have his/her observable behavior recorded in . 
furictidnally descriptive terms rather than' in generalized terminology, 
(labeling). ; ' - ■ . 

■ A child has the right .to have the results of assessments kept confidential ^ , • 
and the records. kept in a locked file.- A child's records shall only be 
iTiade accessible to the chi Id' s. parents and other authorized persons. 



Rights of Parents . / 

^ Parents have the right. that their child receive an overall assessment 
which includes information obtained from health examinations, classroom 
observations, parent conferences,, and home visits. ■ . " 

Parents have the ri^ht to be informed of the purposejpf the assessment, 
and of the instrument(s) to be used in assessing their child; 

Parents have the right to give or, withhold permission to have their . 
child assessed, and to challenge the content -of Written records. 

Parents have the right to be involved in the total assessment process. 

Parents have a right to give input into the overall assessment of their 
child and provide the person(s) doing the assessment with their views 
. and observations of the. behavior, development, and activities of their . 
child. . ^ 

Parents have the right to be infornjed about the assessment results, and ; 
to have conferences With appropriate staff regarding interpretation of 
the results and for program planning.- . 

Parents have a right, at their request, to a written summary of a confer-- 
ence following the assessment. 

■ Parents have the right to confidentiality of all information obtained 'by . 

the assessor. ' o 

Parents have rights reg§rding the releasing of assessirient results to 
• other agencies br public schools. Unless they have given permission, 
the" assessment information shall not be forwarded. . 

Parents have the right to be treated with consideration ah 

redardina the Dsvcholo'aical and social imrjact effects that assessment 
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. • Rights of Staff , " 

The teaching staff .has. the^right to not be^.overburdened by the assessment 
process and recordkeeping to the extent that it interferes vnth theiP^^ 
'■primary teacKing function. It should be recognized/ however^ that making 
and recdrding observations of children are an integral part of teaching. 

-Staff has the. right to give input into, the selection and apprdpriateness 
of assessment" instruments (for both group and individual use), and to 
understand the relevance of the assessment :results_ to.. the overall program. 

Staff has the right to request and receive proper instruction a ' ~ 

. in the use of the assessment instrument and consultation in the inter- . . 
pretation of the results. : 

• Staff :has the right to receive: irifbrmatidn, in advance of the time, ; ^ 
methods, per^sons involved, and spaei to be used when assessment activities ; 
;Will be conducted. 

.Staff has the right to pbject to the use of ajpecific instrument^ 

their -professional opinion, goes contrary to good child development principles. 

Staff has the right to receive timely feedback after the assessment has been 
completed, - . - 
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